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(54) Resolution-triggered sharpening for scaling of a digital-matrix image 



(57) Method and apparatus (1) prepare an image 
( 1 1 , 1 2) for printing and in some cases include an out- 
put stage (18), performing the actual printing - when the 
overall number of pixels is being scaled up or down from 
an original image or portion (12, Fig. 4). Image-sharp- 
ening procedures are controlled automatically by a func- 
tion (38) of the number (23) of pixels in the original image 
and the number (24) in the output device. Any of a great 
variety of such functions may be used, but we prefer a 
step-function of a ratio of the two pixel counts - partic- 
ularly a two-valued step-function in which one value is 
zero and the other serves as a sharpening factor in a 
sharpening algorithm. When the function yields its zero 
value, for efficiency the sharpening computations are 
preferably turned off (51 , 52, 53), The nonzero value is 
automatically selected when the number of output pixels 
is more than twice the number of input pixels. The sharp- 
ening-factor value, ideally two, is multiplied (39) by the 
deviation (37) of each image element's, e_g pixel's (x, 
v> level (32) from the corresponding average (34) of the 
levels (33) lor its adjacent neighbors (x-1 ,v; x,y-1 ; x+1 
x y+1): this product is added to the level of the subject 
image element to form an adjusted level. Weighting (61 , 
71 : 62, 72) or selection of neighbor values along partic- 
ular axes (x. y) allows for anisotropic resolution or an- 
amorphic scaling. 
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Description 



RELATED PATENT DOCUMENTS 



Portions of this document relate to the following copending applications which are commonly owned herewith, and 
incorporated herein by reference: serial 08/145,261, entitled "MIXED RESOLUTION PRINTING FOR COLOR AND 
MONOCHROME PRINTERS' and filed October 29. 1 993, in the names of Donald G. Harris, Majid Azmoon and Gary 

M. Nobel, and issued as U. S. Patent 5, , on . 199 (EP-A-0654352); and serial 08/400,056, entitled 

"MIXED-DENSITY PRINT MASKING IN A MIXED-SWATH-HEIGHT PRINTER' and filed March 6, 1 995, in the names 
of Nicholas NicolofL Jr., John M. Skene, Joseph H. Bauman, Donald G. Harris and Majid Azmoon, and issued as U 
S. Patent 5, , on ,199 . 

BACKGROUND 



15 1 . FIELD OF THE INVENTION 



This invention relates generally to digitally-controlled machines and procedures for printing - subject to enlarge- 
ment or reduction ~ variable-density (gray-scale) text or graphics on printing media such as paper, transparency stock, 
or other glossy media: and more particularly to apparatus and method for preparing images to print on a scanning 
therrnal-inkjet machine constructs monochrome or multicolor text or images from ink spots created on a printing me- 
dium, in a two-dimensional pixel array. 



2. RELATED ART 
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For purposes of this document the terms "enlargement' and 'scaling up" encompass not only making an image 
physically larger but, alternatively, increasing the number of pixels in the image. Depending upon the relative resolu- 
tions per unit length in an original image and a resulting image, the number of pixels may be increased even if the 
overall physical size is held constant or decreased; and the number of pixels may decrease - or may be constant -- 
even if the physical size is increased. 

In fact, "physical size" of an image in many cases is not a well-defined concept. Images are often defined only in 
terms of data arrays - which of course imply nothing about physical size. 

(a) Basic and refined interpolation - United States Patent 5,054, 100 of Tai presents a helpful summary of systems 
used before 1989 to maintain the apparent sharpness of digital images being scaled down or, particularly, scaled up. 
In scaling up (enlargement), to expand the image new pixels must be inserted between preexisting pixels. The ele- 
mentary problem is how to select a density value to assign to each newly inserted pixel. 

Simply replicating the density value of existing pixels would be unacceptable, as such a process would tend to 
form rings of flat-density ledges, as on a topographic map, around each density peak, valley, ridge or other feature. 
Especially for relatively high factors of enlargement, the result would be a conspicuously unnatural stepped-density 
appearance. 

A fundamental approach to selection of new density values for insertion pixels is linear interpolation between 
existing pixel densities of input image data. Tai points out that this technique too is unacceptable, but for a converse 
reason: preexisting sharp boundaries between regions of different density are excessively diluted in visual impact by 
the smoothing or blending effect that is inherent in interpolation. 

The resulting version of the original image is too bland, lacking in crispness of definition particularly in image . 
regions where sharp edges appear in the original. Accordingly previous workers, as enumerated in the Tai patent, 
addressed various schemes for perturbing the interpolation process so as to preserve or recapture some essence of 
the subjectively perceived snap, or kick, in the initial image. 

Considering ihe image-expansion process Irom a mathematical point of view, these lost elements are not solely 
emotional or abstract qualities but have objective physical reality in higher-order components of the density variation 
within an image. It is natural, therefore, to seek a solution through adding higher-order terms to the interpolation process 
- in other words to employ polynomial, for example quadratic or cubic, interpolation formulas. 

Tai makes clear that in such processing it is necessary to strike a compromise between conflicting objectives: 
accuracy in restoring apparent image sharpness, and minimization of data-processing time during printing. As he re- 
counts, some workers have evidently attempted to circumvent this conflict by calculating and tabulating in firmware, 
in advance, some weighting coefficients for use in real-time processing. Others premassage the entire image so that 
it is effectively precompensated for the blending effect of interpolation to be applied. 

Whenever or wherever the extra calculations are performed, all such systems tend to suffer from undesirable cost- 
effectiveness economics. Such adverse relations may take the form of a real-time computational burden on the user, 
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or an overall-price-influencing hardware overhead for which the user pays, or both. 

Cost-effectiveness is particularly adverse in a system that blindly plunges through great volumes of computation 
for images, or in image areas, where computation is unnecessary. For example, all such computations are wasted if 
a particular image or portion actually has no sharp edges to maintain 

Thus Tai reports one prior system which undertakes to determine the presence of edges, and vary the processing 
in response. Related to this approach is Tai's own system, which evaluates the "strength" of an edge, and applies this 
"edge strength" to control weighting factors that in turn modify an interpolation process - which he describes somewhat 
inconsistency as •polynomial", "quadratic bilinear" and "bilinear" interpolation. Tai's interpolation process takes account 
of pixels that are adjacent not only along pixel rows and columns but also diagonally. 

Tai's sharpening technique can operate simultaneously with determination of new pixel values for insertion (needing 
no pre- or postprocessing), and thus appears to be reasonably fast. In some embodiments it potentially avoids needless 
processing by, in effect, switching in needed weighting factors only where edge strength is within a specified range -- 
namely, high enough to be worth retaining, but not so high that contrast still looks good even if the edge is degraded 
somewhat. 

It appears that the Tai system should produce very high image quality, but it does remain computationally very 
intensive. In particular it tests edge strength throughout an image -- and strengthens or sharpens the edge - even 
under some circumstances in which objectionable edge degradation cannot occur. 

Recognition of this last point is considered part of the inventive contribution of the present invention, and so will 
be set forth more fully in a later "Summary of the Invention" section of this document. 

(t>) A sharpening algorithm -- One technique that is commonly regarded as a standard form of so-called "edge 
enhancement" involves an initial analysis akin to Tai's, but most-typical ly simplified by omission of adjustment for di- 
agonally adjacent pixels. This standard technique sharpens images by applying to each pixel an algorithm that performs 
a simplified form of interpolation. 

Fig. 1 defines image positions to which the algorithm refers, namely five pixels in the input image. The five pixels are: 

■ a subject pixel whose gray-scale value, or density, is to be adjusted » at array position (x,^) -- and 

■ its four nearest neighbors at pixel positions (x-1 ,y) and (x+1 ^) to the left and right, and (x,y-1 ) and (x,y+1 ) below 
and above. 

Fig. 1 shows that positions varying by values of x - that is. measured along an x axis - correspond to a carriage- 
scan reciprocating direction that is symbolized in this drawing by a two-headed or bidirectional horizontal arrow 3C. 
Positions varying according to increasing values of y - positive movement along an orthogonal y axis - correspond 
to a medium-advance direction symbolized by a unidirectional (downward pointing) vertical arrow 3M. 

Of interest are the gray-scale values V, or densities, at these five positions. The densities or gray-scale values are 
correspondingly written for the subject pixel V(x,^) and for the neighbors V(x-1 ,y), V(x+1 ,^), V(x,y-1 ) and V(x,y+1 ). 

In conventional terminology a new gray-scale value for the subject pixel is said to be a "sharpened value" V s or 
sometimes even a "sharpened pixel". It will be understood that this is only a verbal shorthand, since it is meaningless 
to speak literally of sharpening a single pixel or its gray-scale value as such, considered in isolation. The terminology 
of course means that the pixel gray-scale value is adjusted in such a way as to sharpen or enhance the contrast of the 
image in a region, surrounding the subject pixel, of varying gray-scale value. 

To calculate a "sharpened" value V(x,v) s the initial unsharpened value V(x,y) and the neighboring values are com- 
bined with a "sharpening parameter" S in this way: 



y(x.y) 3 = y(x ; y) + S-{y(x.y)- 
% [V(x-1.y) + V(x+1,y) + V(x,y-1) + V(x,y+t)]} 



This formula calls for averaging (in the second line of the formula) the gray-scale values for the neighbor pixels of 
(x,y). The neighboring-pixel gray-scale values may be collectively symbolized as V neighbofS , and their average may be 
abbreviated as ^V neighbors . 

The formula subtracts that average from V(x,y) -- to yield a difference V(x,y) - ^£V neighbon5 that represents the 
gray-scale or density deviation , which may be written AV. of the subject pixel from its average surroundings. 

The formula then multiplies that resulting difference AV by the sharpening parameter S. This product SaV of the 
difference and the parameter S is an enhanced or exaggerated representation of the deviation of the subject pixel from 
its average surroundings - the degree or extent of the enhancement being of course set by the parameter S. 

(In principle the same technique can be used to provide blending or smoothing by using values of S that are 
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fractional ~ so that the deviation is partially suppression or constrained, rather than exaggerated or enhanced. That 
application is not of particular interest for present purposes.) 

The exaggerated deviation SaV is then added back to the original "unsharpened" value V(x,^) to yield the "sharp- 
ened" value \flxjk. V(x,a) + SaV. People who are skilled in the art will appreciate that this sharpening on one hand 
5 may be totally ineffective, or may provide an excellent improvement, or on the other hand may introduce unsatisfactory 
excessive elevation of apparent contrast and different results mav obtain in different regions within a single image 

The actual result depends upon several unstated or uncontrolled factors such as for instance the magnitude of 
the sharpening parameter S, absolute values of the gray-scale numbers V and relationships between them, and the 
relative size of the deviation AV = V (x.y) - J4lV neighbors from surroundings. Still another factor is the subjective character 
*0 or mood of the input image in the region of interest. 

Of these uncertainties, the first mentioned - selection of the sharpening parameter S - presents a paramount 
difficulty. It is analogous to Tar's selection of his 'weight factor multipliers', and critical to both the quality of the results 
and the operating speed or cost-effectiveness of the system. 

In prior printing or print-preprocessing systems of which we are aware, the sharpening parameter S has been 
'5 made either always a fixed value or entirely subject to control by a human operator In the latter case, the operator 
typically can set S to zero, thus effectively turning off the sharpening function, or can select any desired value -- within 
some permitted range - arbitrarily. 

Thus desired degrees of sharpening can be explored and selected by the operator through trial and error Machine 
time as such, in processing and printing each image, thus may be made quite modest - or at least appropriate to the 
20 circumstances -- if the operator selects suitable values. This result, however, of course is obtained at the expense of 
a relatively massive burden on the time of the operator. 

Furthermore the quality of the results in such systems depends upon the operator's perceptions (significant frac- 
tions of otherwise well-qualified operators are red-green colorblind), skill and patience. Since what is ideally desired 
in most cases is an output that bears a relatively straightforward or mechanistic relationship to the input data, such 
2S variability is usually a drawback. 

Typically if the image is multichannel - for example, parallel planes or channels of red, green and blue ("RGB") 
data - then the entire sharpening -algorithm operation is performed separately for each channel. Naturally this overall 
approach multiplies the adverse time or cost burdens discussed above. 

After the sharpening algorithm has been applied as described above, to form an intermediate image array, it still 
30 remains for the system to insert pixels and so expand (or to remove pixels and so contract) the image data to the 
number of overall pixels needed for the desired output image size at the resolution of the output device that will be 
used. Establishing gray-scale values for inserted pixels is preferably done by strictly linear interpolation from the inter- 
mediate, but can employ the even simpler process of pixel replication if desired. 

As a practical matter it is not necessary to process the entire image before beginning the interpolation or replication. 
3S Typically the sharpening and insertion can be accomplished in immediate succession using a rolling or progressively 
advancing window of the same height as the neighbors used in the sharpening algorithm (Fig. 1 ) i. e.. a three-pixel- 
row window. 

If desired the actual printout of each pixel row can begin as soon as the sharpening-and-insertion window has 
advanced past that row. Thus the sharpening algorithm considered in the abstract - that is, apart from the indeterminacy 
40 in selection of the sharpening parameter S - - represents an operationally practical approach. Selection of that param- 
eter S, however, as made clear above, is severely problematic. 

(c) Conclusion -- Excessive or unjustified computation time and cost or great impositions on operator time, patience 
and abilities, heretofore have continued to impede achievement of uniformly excellent but economical image scaling, 
preparatory to mkjet and other printing at high throughput. Thus important aspects of the technology used in the field 
4 5 of the invention remain amenable to useful refinement. 



SUMMARY OF THE DISCLOSURE 



The present invention introduces such refinement. In its preferred embodiments, the present invention has several 
aspects or facets that can be used independently, although they are preferably employed together to optimize their 
benefits. 

In preferred embodiments of a first facet or aspect of its aspects, the invention is apparatus for preparing an image 
to print, on a print medium, as marks formed in an array. The array has some output-device resolution - that is to say., 
some resolution that is characteristic of an output device. 

The apparatus performs this image-preparing task based upon input image data. This image data defines a pixel 
array that has some input-data resolution - some resolution that is characteristic of the input data. 

Resolution information is stated as a number of image elements - usually pixels, for digital image data - per some 
distance. Perhaps most traditionally used in such definitions is a unit distance, yielding for example "pixels per millim- 
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eter" or "per inch 9 . 

For purposes of this document the reference distances are the entire image dimensions being scaled, not a unit 
distance, and thus yield resolution expressions such as *350 by 500 pixels' for rectangular image. Thus in effect the 
resolution figures employed take account of the overall image-size change, as well as the input/output relationships 

s with respect to fineness of detail in each elemental part of an image. 

Input resolution on a unit<Jistance basis, and output resolution on a unit-distance basis, are usually isotropic - i. 
a, images usually have the same number of pixels per unit distance in two orthogonal directions (such as carriage" 
scan axis and print-medium advance axis). In many high-quality modern printers, however, this condition is not met, 
and for purposes of the present invention some special convention must be adopted to accommodate the divergence; 

io some such details will be specified later in this document. A like accommodation may be made if desired to apply the 
invention to accommodate anamorphic enlargements -- i_e_ enlargement by different factors in two orthogonal direc- 
tions 

The apparatus includes some means for finding at least one equivalent gray-scale level for a selected element of 
the input data These means are also for finding at least one equivalent gray-scale level for, respectively, each of a 
is plurality of elements of the input data that are near the selected element. 

For purposes of generality and breadth in discussing the invention, these means may be called the "gray-scale- 
level finding means" or more simply the "finding means". 

In describing the finding means we use the phrase "equivalent gray-scale level" to encompass both an actual gray- 
scale level, such as is found in a multilevel black-and-white image, and also data that may be used in forming any 
20 other monochrome image. Such a monochrome image may be for example an image all in different densities of, say, 
green, or magenta. 

The terminology thus also encompasses systems that process plural (for example, three chromatic-color primary 
and one black) monochrome data channels or color "planes", for later assembly into a plural<;olor (for example full- 
color) image. In addition the terminology "equivalent gray-scale level" also encompasses finding a single over-all equiv- 
2S alent gray-scale level - le., equivalent to a composite gray-scale level of a plural^olor image portion - for use in 
printing a monochrome (for instance black-and-white) version of a plural-color image. 

Besides the finding means, the apparatus of this first aspect of the invention also includes some means for auto- 
matically adjusting the equivalent gray-scale level for the selected element. The aim of this automatic adjustment is to 
derive a new equivalent gray-scale level which depends upon: 
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■ a function of both the output-device resolution and the input-data resolution, and 

■ the found equivalent gray-scale levels for the selected element and each of said plurality of near elements. 

Here too for breadth and generality these means may be denominated the "adjusting means" 

In describing the adjusting means we have used the phrase "to derive a new equivalent gray-scale level". By this 

terminology we encompass two general alternatives: the original data may itself be revised, actually substituting the 

new gray-scale level; or preferably the original data may be only used as a basis for preparation of a new intermediate 

data array, leaving the original data unchanged. 

Further the apparatus includes some means for using the new equivalent gray-scale level to form corresponding 

output data having the output-device resolution. Once again it may be helpful to refer to these means as the "using 

means'. 

The using means may proceed by simple replication of pixels, or by some form of interpolation, or by combinations 
of these or other techniques whether now known or unknown. The new equivalent gray-scale levels produced by 
the adjusting means can be made to, in effect, precondition the image so that contrast or sharpening of its internal 
edges will be satisfactory even after this later processing by the using means. 

The foregoing may constitute a description or definition of the first facet of the invention in its broadest or most 
general form. Even in this general form, however, it can be seen that this aspect of the invention significantly mitigates 
the difficulties left unresolved in the art. 

In particular, by controlling the gray-scale level in dependence upon the characteristic output and input resolutions, 
the image may be processed only to an extent that is justified by the number of new pixels to be inserted. This critical 
consideration, interestingly, is not found in the otherwise sophisticated analyses of Tai, or the heretofore known sharp- 
ening algorithms. 

Hence the new equivalent gray-scale level may be made to diverge very strongly from the original level when the 
number of pixels at each location in the original image is to be cloned or interpolated by a relatively large multiplication 
factor such as two or more. At the same time the new equivalent gray-scale level may be made to diverge very little -- 
or not at all - from the originat when very few pixels are to be inserted. 

The invention offers the opportunity to take advantage of this dependence on the relative input/output resolutions 
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to effect great economies in data processing. Specifically, the resolution dependence can be used in such a way as to 
minim.ze or even eliminate data-processing - for the purpose of sharpening - when so few pixels will be inserted that 
little or no image-quality improvement can be gained by sharpening. 

This economy is particularly valuable because the resolutions involved, in determining how to proceed are appli- 
cable to the enure image - not piecemeal to different portions of the image. Thus the number of pieces of information 
to be evaluated in the decision-making stage typically amount to only one or two values (or the input data and one or 
two values for the output device - in other words, most typically perhaps two to four quantities in all 

This means that a single very simple calculation, or sometimes a very tew such calculations, are all that is needed 
to establish whether sharpening calculations are needed for an entire image - and. if so. the extent or scope of the 
calculations. The processing overhead involved in the present invention is, in short negligible 

Although this aspect ol the invention in its broad form thus represents a significant advance in the art. it is preferably 
pranced m conjunction with certain other features or characteristics that further enhance enjoyment of overall benefits 

For example, rt is preferred that the apparatus be further combined with an output device, for printing the selected 
element on the pnnt medium using the output data. Also preferably the output device includes a thermal-inkjet pen 
and the f.ndmg, adjusting and using means include at least one digital microprocessor programmed to perform the 
finding, adjusting and using. 

The apparatus itself preferably further includes means tor defining and evaluating the function of both the output- 
device resolution and input^lata resolution for the selected element. We consider it most preferable that the function 
be a function of the ratio of the input <Jata resolution to the output-device resolution for the selected element 

We prefer to make the function a step-function of that ratio. It has been found particularly advantageous to make 
the function on the order of two for certain values of the ratio, and on the order of zero for other values of the ratio 

Also preferably the function takes one value if the ratio does not exceed approximately one-half; and otherwise 
takes another value. Ideally the function is two if the ratio is one-hatf or less, and zero otherwise 

We consider it preferable that the new equivalent gray-scale level be substantially equal to: 

■ the found equivalent gray-scale level for the selected element, plus 

■ the product of (a) the function and <b) a function of the found equivalent gray-scale levels for the selected element 
and each of the plurality of near elements. 

Still more preferably, the function "(b)" just mentioned is the difference between: 

■ the found equivalent gray-scale level for the selected element and 

■ an average of the found equivalent gray-scale levels for each of the plurality of near elements. 

Special considerations come into play if the apparatus is intended for preparing such an image that is a color 
image to print on an output device that includes means for selectively printing any of a plurality of colorants to maTk 
the selected element on the print medium in color. 

Here preferably the finding means include means for finding an equivalent gray-scale level with respect to each 
colorant of the plurality, for the selected element and for each of the plurality of near elements. Also preferably the 
adjusting means mclude means for adjusting the equivalent gray-scale level for each colorant of the plurality, to derive 
a new equivalent gray-scale level. This new gray-scale level depends upon: 

■ a function of both the output-device resolution and the input-data resolution lor that colorant respectively, and 

■ the found equivalent gray-scale levels with respect to that colorant, for the selected element and each of the plurality 
of near elements. 

Preferred embodiments of the first aspect or phase of the invention further include some means for rendition of 
he new equivalent gray-scale level in a binary pixel array: for reasons to be explored later, the invention has been 
found particularly efficacious h the environment of a binary (single-bit) color printing system. Preferably too the finding 
means employ, for the plurality of "near" elements, elements that are substantially adjacent to the selected element 

Moreover the new equivalent gray-scale level preferably depends on the input/output-resolution function and the 
equwalent gray-scale levels substantially exclusively. In this regard, as mentioned earlier, each resolution value to 
which the terminology used in this document refers is the number of pixels per entire image, not per unit distance 

Preferred embodiments of a second main facet or aspect of the invention, too. take the form of apparatus for 
preparing an ,mage to print on a print medium as marks formed in an array having output<Jevice resolution based 
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' upon input image data defining a pixel array having input<Jata resolution. The definitions of "resolution" employed here 
as throughout this document are the same as set forth above for the first main aspect of the invention. 

In this case, however, the apparatus includes some means for using the input data to form corresponding output 
data having the output-device resolution. The apparatus also includes some means for finding at least one equivalent 
5 gray-scale level for a selected element of the output data, and for each of a plurality of elements of the output data 
that are near the selected element. 

In addition the apparatus includes some means for automatically adjusting the equivalent gray-scale level for the 
selected element to a new equivalent gray-scale level which depends upon: 

10 m a function of both the output-device resolution and the input-data resolution, and 

■ the found equivalent gray-scale levels for the selected element and each of the plurality of near elements. 

Thus in very broad terms it can be seen that this second aspect of the invention has using, finding and adjusting means 
*5 that are very roughly analogous to the using, finding and adjusting means of the first aspect. 

They are not. however, identical or interchangeable. The order in which they operate on the successive forms of 
the data is different, as between the two aspects. 

In the first broad aspect of the invention, data definition ("finding") precedes pixel sharpening ('adjusting" the found 
data)., which in turn precedes pixel expansion ("using* the adjusted data). In this second aspect, pixel expansion ("us- 
20 jng") comes first, and then data selection ("finding" the expanded data) and then sharpening ("adjusting" the found 
data). 

In general for enlargements, or at least for increases in resolution as defined in this document, the first aspect of 
the invention is preferable to the second - because the first aspect of the invention performs sharpening calculations 
while the amount of data in the image is still smaller, but the second aspect sharpens all of the expanded data. The 
2S Tai reference, discussed earlier makes this point. 

The sharpening of expanded data, however, does produce different output quality or at least visual impact, and 
this different output may be advantageous in some situations simply because some operators or customers, etc. may 
prefer it. Thus a significant comparison is between operation of the second aspect of the invention and prior systems 
that likewise sharpen expanded data. 
30 in this regard the present invention is superior to such prior systems, in that limited or no sharpening is performed 

when resolution relationships do not call for heavy, or any, sharpening. In fact the advantage of the present invention 
over the prior art is even more significant for this second aspect of the invention than for the first, because the amount 
of superfluous data processing that can be avoided in this case is much more extensive and time consuming. 

Although this second aspect of the invention in its broad form thus represents a significant advance in the art, it 
35 j s preferably practiced in conjunction with certain other features or characteristics that further enhance enjoyment of 
overall benefits. Generally most of the same preferences mentioned above for the first aspect of the invention are 
applicable to this second aspect too. 

In preferred embodiments of a third basic aspect or facet, like the first two, the invention is apparatus for preparing 
to print an image on a print medium as marks formed in an array having output-device resolution, based upon input 
to image data defining a pixel array having input-data resolution. 

The apparatus includes some means for enhancing contrast within the image. In the interest of breadth and gen- 
erality we will call these means the "enhancing means'. (As will be understood, these means have the effect of sharp- 
ening the image, and if desired may be used in association with - le., just before or after - scaling of the image.) 
This apparatus also includes some means for automatically turning the enhancing means on or off selectively The 
45 turning of the enhancing means on or off is made to depend on a relationship between the output-device resolution 
and the input -data resolution. 

The foregoing may constitute a description or definition of the third facet of the invention in its broadest or most 
general form. Even in this general form, however, it can be seen that this aspect of the invention too significantly 
mitigates the difficulties left unresolved in the art. 
50 In particular the input/output-device resolution relations are used to determine whether image enhancement (e. q. 

sharpening) is performed at all. Enhancement is performed for some resolution relationships but not others. 

As will be clear to people skilled in this field, this aspect of the invention provides an opportunity to entirely eliminate 
time-consuming enhancement processing when little can be gained by such processing - specifically for example, 
when not enough pixels are being inserted to make the inherent blending or smoothing effects of pixel insertion no- 
5 5 ticeable. 

Here too such benefits can be optimized through incorporation of additional features or characteristics. Most of 
the preferable points mentioned earlier in relation to the first aspect of the invention are applicable to this third aspect 
as well. 
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In preferred embodiments of a fourth of its aspects, the invention is a method of printing an image on a print 
medium. Such an .mage is printed as marks formed in an array having output-device resolution, based upon input 
image data defining a pixel array having input-data resolution. 

The method includes the step of finding at least one equivalent gray-scale level for a selected element of the input 
5 data ~ and for each of a plurality of elements of the input data that are near the selected element - respectively 

The method also includes the step of automatically adjusting the equivalent gray-scale level for the selected ele- 
ment to derive a new equivalent gray-scale level. The new equivalent gray-scale level depends upon: 

■ a function of both the output-device resolution and the input-data resolution and 

10 

M the found equivalent gray-scale levels for the selected element and each of said plurality of near elements. 

The method also includes the step of using the new equivalent gray-scale level to form corresponding output data 
having the output-device resolution. In addition the method includes the step of printing the selected element on the 
'5 print medium using the output data. 

Practice of this method enjoys generally the same advances over the prior art as use of the apparatus described 
earlier in a preferred embodiment of the first aspect of the invention. Related preferable forms of the apparatus are 
applicable here too, as preferable modes of practicing the method. 

Additional preferences are stated below for this method aspect of the invention. These preferences conversely 
20 have advantageous analogues in the apparatus aspects of the invention. 

A first preference arises when the method is used for printing an image in color, using an output device that has 
different resolutions for different colors. In this case preferably the function is a function of all the resolutions for the 
colors which the output device can print. 

More specifically it is preferable that the overall function - that is, the above-mentioned function of all the resolutions 
25 - be such that the individual resolution function used for each color is a function of the output-device and input-data 
resolution for that same color. 

A second preference arises when using an output device that has different resolutions along different dimensions 
along different dimensions of the mark-formed array, or when using an input image that has different resolutions along 
different dimensions of the input data, or both. Here it is preferable that the function be a function of all the resolutions 
30 for the different dimensions. 

More specifically it is preferable that the overall function - that is. the just-mentioned function of all the resolutions 
- include weighted functions used with respect to each common dimension, respectively, of the input -data pixel array 
and the mark-formed (output) array. In other words one weighted function may be used with respect to the width (or 
carriage-scan dimension) of the input and output arrays; and another one weighted function may be used with respect 
to the height (or medium -advance dimension) of the input and output arrays. 

An alternative preference, within the general preference for using a function of all the resolutions, is that the finding 
step include finding the at least one equivalent gray-scale level for each of a plurality of elements of the input data that 
are near the selected element along, exclusively, a particular common dimension of the input-data pixel array and the 
mark-formed array. In other words, this form of the invention ignores elements along the orthogonal dimension from 
the selected element i^e,, the weighing factors mentioned in the preceding paragraph are set equal to zero for that 
orthogonal dimension. 

An example will make this more clear. Suppose that the two resolutions of the output device expressed on a unit- 
distance basis are 600 pixels per inch along the carriage scan axis and 300 pixels per inch along the print-medium 
advance axis. The system outlined in the preceding paragraph would use only either the 600 or 300 figure, not both. 
Since the output-device characteristics are known in advance, the selection of which axis to use can be made by the 
system designer: for instance, if desired the system may be programmed to use the 600-pixel figure, as this corresponds 
to the direction in which undesirable image blending or smoothing will be most troublesome. 

In this alternative case, the adjusting step then proceeds based upon exclusively the elements along the selected 
dimension. Thus the new equivalent gray-scale level depends upon the function and the found levels for the selected 
element and. exclusively, the elements along the particular common dimension. 

All of the foregoing operational principles and advantages of the present invention will be more fully appreciated 
upon consideration of the following detailed description, with reference to the appended drawings, of which: 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram defining pixel-grid positions for the geometrical relationship between a subject pixel to be 
adjusted or "sharpened - and its adjacent neighbors; 

Fig 2 is a perspective view of a printer that may be used as the "output device' with the invention, or as part of 
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the invention; 

Fig. 3 is a like view, but enlarged, of a pen carriage that may form pari of the Fig 2 printer; 

Fig. 4 is a diagram of possible relationships between input-data resolution and output-device resolution, for a 

monochrome case: 

5 Fig. 5 is a like diagram of such relations for a four-colorant case - very generally corresponding to the Fig. 2 pen 

carriage: 

Fig 6 is a block-diagrammatic representation of a preferred hardware system according to the first aspect of the 
invention; 

Fig. 7 is a like diagram corresponding to the second main facet or aspect of the invention; 
10 Fig. 8 is a like diagram corresponding to the third facet of invention; 

Fig. 9 is a flow diagram corresponding to method of the fourth main aspect or facet of the invention; 
Fig. 10 is a like diagram showing one exemplary embodiment of the Fig. 9 method: and 
Fig. 11 is a like diagram showing an alternative exemplary embodiment of the Fig 9 method 

'5 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. 2 illustrates an output device i capable of implementing the geometrical relationships of Fig. 1 . The device 1 
is a thermal-inkjet ("TIJ") printer with a tray 2 for holding sheets 4 of printing medium ready for use, and a printed- 
image exit region 5 and storage shelf 6. 
20 a print-medium advance mechanism within the printer 1 picks up an individual sheet 4 of medium and moves the 

sheet along a medium-advance direction 3M which corresponds to the like direction 3M in Fig. 1 . For purposes of this 
document the advance mechanism too, which is generally conventional, may be regarded as symbolized by the arrow 
3M. 

The printer 1 also includes a carriage 7 that holds three color pens 8CMY and one black pen 8K. The carriage is 
25 supported for motion on a system of rods 9, bearings 9B (Fig. 3), a rail 9R and a rail follower 9F. 

The carriage motion 3C is reciprocating and corresponds to the like direction 3C in Fig. 1 . Thus the pens are held 
in marking positions above an individual sheet 4 of medium that is partway along its longitudinal path 3M through the 
system, and the pens bidirectionally scan over the sheet 4 of medium transversely - while marking on the sheet 4 to 
create an image. 

30 The image to be printed may arise in any of a very great number of ways. For example it may be created as digital 

data using a programmed digital microprocessor - most typically part of a general-purpose computer that includes a 
display screen for viewing the image during its creation, and that is functionally interconnected with the printer 1 for 
producing a so-called "hard copy" on paper. 

Alternatively the image may be originally a photo or a handmade drawing or painting that is captured as digital 

35 image data using an optoelectronic scanner, or may be recorded as data representing physical processes, financial 
data etc. Image data may be created in other ways that are known, and some ways that are not yet known. 

Generally speaking all such image data may be satisfactorily processed in accordance with the present invention: 
however, the invention is most effective and most useful with natural pictorial image types. By this we mean photos, 
paintings or drawings of people and scenes, in which small details when closely examined seem to have a degree of 

40 randomness. 

Image data once assembled may be recorded on any of various types of storage media, and may be carried on 
such media for copying into another computer - or transmitted by phone, radio, optical or other transmission systems 
for copying into a remote computer - that has an output device 1 for printing the image. 

A set of digital image data merely represents an image in terms of intensities or densities of one or more colorants 
45 at a number of positions or "picture elements", "pixels", into which the image area has been divided. Generally the 
data set as such contains no indication of the physical size of an individual pixel or of the overall image. 

Often physical size is not of direct interest - since usable, visible reproductions on a display screen or printing 
medium may be made at any of a great number of desired sizes. Nevertheless for purposes of discussion Fig. 4 shows 
actual size relationships between an original picture 11, a portion 12 of that picture which is to be reproduced 14 using 
50 a printer, and the finished printout 15 of that desired portion 12. 

For clarity of illustration, each pixel diagram in this document has been prepared with many fewer pixels than a 
typical image of interest. Those skilled in the art know well that a typical image is hundreds of pixels on each side. 

Commonly encountered pixel counts range from at least several dozen into the thousands. Nevertheless, the 
diagrams in this document are adequately representative to help explain the purposes and practice of the invention. 
55 As Fig. 4 shows : not only the whole original picture 11 but also the portion 1 2 to be reproduced is physically larger 

than the desired printout 15 of the portion 12. Nevertheless, for the example shown the reproduction process 14 is an 
"enlargement" within the meaning of that term introduced earlier in that document - namely, that the number of pixels 
in the printout 15 is greater than the number in the portion 1 2 to be reproduced 
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Such relationships are possible because, as Fig. 4 shows, the actual, physical pixel spacing in the original 11 is 
much coarser than that in the printout 15. The portion 12 is seven pixels across its horizontal (carriage-scan axis) 
dimension 1 3x, and six pixels along its vertical (medium-advance axis) dimension 1 3v. 

The reproduction or printout 1 5 is in the same proportions, but in actual physical size only about three-quarters as 
big in each direction. It has fourteen pixels across its horizontal dimension 16x, and twelve pixels along its vertical 
dimension 16y -- twice as many in each direction as in the original portion 12, so each pixel side in the printed output 
is only about three-eighths the length of each pixel side in the original 11,12. 

Within the terminology of this document, the reproduction process 1 4 is an enlargement by a factor of two in each 
direction, wnich is to say from seven pixels across to fourteen pixels across, and from six down to twelve down. This 
is accordingly a relatively simple case, for images 12 may be subject to compound enlargement factors (or even si- 
multaneous enlargement and reduction) where plural colors or anisotropic resolution - or both - are involved as in 
Fig. 5. 

Fig. 5 represents an original image portion 12 with data subsets C, M, Y and K for four colorants or primary colors 
cyan, magenta, yellow and black respectively ~ sometimes called different color "channels" or more commonly different 
color "planes". The input data are assumed to have a single common resolution value for all four colors: the pixel 
spacing is drawn the same in all four color planes. 

These input data are also assumed to be isotropic in resolution: the pixel spacing has been drawn the same along 
the horizontal and vertical axes x and v respectively. The image portion itself, however, is not square but rectangular 
being seventeen pixels tall (the vertical dimension 1 3y) and thirteen wide (horizontal dimension 13x). 

The output form of the same data, after image processing 14 to format the data for an output device (such as the 
printer 1 ), has been drawn variegated in resolution to illustrate the kinds of compound enlargement situations that can 
arise. The color-data planes C, M ; Y are isotropic, and pixels in the data planes C, M for printing cyan and magenta 
are a common size - but this is only three-quarters the size (along each side) of pixels in the data plane Y for yellow 

Pixels in the plane K for printing black are strongly anisotropic ~ twice as tall as they are wide. They are also 
different in both dimensions from pixels in all three planes C, M, Y for printing chromatic colors. For instance in com- 
parison with pixels in the data Y for yellow, the pixels in the data K for black are five-fourths as tall (1.2 times taller ) 
and five-eighths as wide. 

More significantly for purposes of the present invention, all these output-device pixel dimensions bear various 
relationships to the pixel dimensions for the input data 12. To determine the factor of "enlargement" or "reduction" as 
herein defined, it is necessary to take into account also the overall input-image dimensions 1 3x, 1 3y and output-image 
dimensions 1 6x. 1 6v for all four output-device data planes (that is, 1 6xc M and 1 6y c M for cyan and magenta. 1 6x Y and 
1 6y Y for yellow, and 1 6x K and 1 6y K f or black) . 

In this tabulation the "scale factor" column represents the "enlargement" as herein defined, the final figure (being 
less than one) accordingly representing a reduction. 



color 


direction 


pixel scale factor 


frame scale factor 


enlargement 


cyan 


both 


4/3 


x7/6 


1.56 


magenta 


both 


4/3 


x7/6 


1.56 


yellow 


both 


1 


x7/6 


1.17 


black 


horizontal 


8/5 


X7/6 


1.87 




vertical 


4/5 


X7/6 


0.93 



45 As will be understood, approximately the same ratios (not exactly, because the data planes were not drawn with integral 
numbers of pixels across and down all frames) can be obtained more simply by merely counting pixels across and 
down the input- and output-data frames: 
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pixels, input frame 


pixels, output frame 


enlargement 
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cyan 


horizontal 


13 


21 


1.62 






vertical 


17 


27 


1.59 




magenta 


horizontal 


13 


21 


1.62 






vertical 


17 


27 


1.59 
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yellow 


horizontal 


13 


16 


1.23 






vertical 


17 


20 


1.18 




black 


horizontal 


13 


25 


1.92 
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16 


0.94 
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(In images with more-typical ly very large numbers of pixels, the effects of one fractional pixel across an entire frame 
would be negligible and the enlargement ratios more accurate.) 

The various ■enlargement" factors or "resolution" relationships of Fig. 5 can be important to practice of the present 
invention because they demonstrate that a function of the input-data and output-device resolutions may be a compound 
or hybrid function. Its complexities must be addressed, though not necessarily in a complicated way, to enable practice 
of the invention with output devices having these kinds of resolution relationship. 

Actual resolution relations of this sort may represent a very desirable mode of practice of the invention when used 
with certain printers that have different resolutions for different dimensions, or as between different primary colors. The 
patent documents enumerated earlier, in the Related Patent Documents section, set forth such details. 

Fig. 6 shows one preferred embodiment of the apparatus of the invention as it works on image data 21 for - 
typically -- one selected pixel such as x,v of Fig. 1, but taking into account data 22 for - typically -- the four nearest- 
adjacent pixels. Fig. 6 deals with the relatively simple case of a monochrome image portion 12 to be printed, but may 
also represent processing of such an image portion 12 that is a single monochrome channel or plane in a plural-color 
image. 

An input reading or "finding" stage 25 of the apparatus provides one data pathway 26 that finds and reads V(x,y) 
- the selected-pixel data 21 -- and a second data path 27 that finds and reads V neighl>orst the adjacent-pixel set 22. In 
the drawings as in the claims, the term "element" is used rather than "pixel" because some systems operate on groups 
of pixels, rather than individual pixels, as elementary units. 

As seen, the system also reads and uses a third type of information 23 derived from the input image portion 12, 
namely the "input-data resolution" - which is the number of pixels along an edge of the image portion 12. For some 
systems that operate on plural-pixel elements as mentioned above, it may be desirable to adapt the definition of "res- 
olution" as will be clear to those skilled in the art. 

The second data path 27 transmits equivalent gray-scale levels 33 for the adjacent elements to an intermediate 
level-adjusting stage 42, in which one module 34 finds their average 35 - which corresponds to the previously intro- 
duced notation ^IV^^. A second module 36 finds the difference 37 - which is AV = V(x,y) - ^V nejght>ors -- between 
this average 36 and the gray-scale level 32 for the selected element. 

A fourth module 39 multiplies the difference 37 by the previously mentioned sharpening parameter 38 - which 
corresponds to the parameter S in the sharpening algorithm presented earlier. This parameter is supplied by a separate 
module 28 which operates to define and evaluate a function of the input and output resolutions 23, 24 - for simplicity 
preferably, as noted in the drawing, a step-function of the ratio of the two resolution values. 

The defining-and-evaluating means 28 receives the input-data resolution figure 23 mentioned above, and also 
reads the output-device resolution 24. While this parameter 24 appears in the drawing as provided by the output device 
1 7, naturally in some systems this information is prestored in the microprocessor system (e^, computer) that performs 
these preliminary operations. 

For example, the module 28 may be part of a computer that has been programmed to run printer-driver software, 
and the computer may have received the output-device resolution information 24 from the printer driver - which is 
typically operator-selected and -installed for an individual printer 17. In this case the computer then reads this infor- 
mation 24 from its own memory. 

Whether derived in that manner or by interrogation of the printer 17 as illustrated, the output resolution 24 is 
combined with the input resolution 23 in the defining-and-evaluating means 28, and the prescribed function 38 is applied 
as the sharpening parameter S to the multiplication module 39. Making the function 38 (sharpening parameter S) a 
function of the two resolution values 23 24 enables the system to perform relatively more extensive sharpening (higher 
S values) in some cases and relatively less (tower S values) in others - or, in a particularly efficient preferred embod- 
iment, to perform sharpening when it is needed, and omit sharpening when it is not needed. 

The output 40 of this multiplication stage 39 - which is the correction or adjustment term SAV -- is added back to 
the selected-pixel level 31 : V(x,v), within a summing module 41 . The result is the adjusted gray-scale level 43 for the 
selected pixel - V(x,y) s - which then leaves the adjusting stage 42. 

In the next stage 44 the adjusted gray-scale level 43 passes into an output-stage or "using" stage 44, which forms 
14 output data 15 - by performing the image expansion (or contraction) process 14 of Figs. 4 and 5. The case of 
expansion is of greater interest relative to the present invention, since it is expansion which requires insertion of new 
pixels by replication or interpolation - and it is these processes which tend to excessively smooth or blend the image. 

Several or other processes typically occur in an output stage 44, or in an output device 17 itself, or functionally 
divided between these two subsystems. For example if the output device is a one-bit binary printer, binary pixel rendition 
45 may be performed within the output or "using" stage 44 of the programmed microprocessor. Color correction may 
be performed between the expansion and rendition modules 14, 45 - or earlier, as for example in formation of the 
input data 12. 

In any event the microprocessor output 46 eventually passes to the output device 1 7, for control of marking devices 
such as a TIJ pen or pens 8. These in turn produce marks 47 to create the desired printout 18. 
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In the remaining drawings, features related to those of Fig. 6 are designated by the same reference numerals that 
appear in Fig. 6. Where appropriate to call attention to variant functions, prefixes "1", "2" etc. are appended in the 
hundreds position. 

Thus in Fig. 7 the expansion process 114 precedes sharpening (rather than following as in Fig. 6). so the input 
data 1 1 1 2 operates differently (from the data 1 2 of Fig. 6) in that it provides only one data line 121 (rather than two 21 , 
22 as in Fig. 6). The expansion or output-data "forming' process 114 occurs in an input or data-using stage 144, 
generating two output-signal sets: the equivalent gray-scale level 11 5 for the selected pixel, and equivalent gray-scale 
levels 11 5Wor its neighbors. 

These signals proceed to the subsequent modules 125, 142 which operate very much as in the Fig. 6 system, 
except that in the now already-expanded data there are many more pixels to process. This system is accordingly 
disfavored, unless special circumstances lead to much better image quality through this inverted sequence. 

The resolution-function defining-and-evaluating module 1 23 provides a sharpening parameter 138 very much as 
in the Fig. 6 system. As in that system the value of the parameter 138 is preferably the result of a function of the 
resolution ratio - and still more preferably a step-function of that ratio. In a sense the usefulness of this part of the 
system is even greater than in Fig. 6, since here the stakes are higher: the amount of processing that can be wasted 
in this system is potentially dozens or even hundreds of times greater than in the Fig. 6 system. 

For convenience of illustration, in Fig. 7 the rendition process 145 is shown as being perlormed by the output 
device 117 rather than within the computer or other program med-microprocessor system 144-125-142. Accordingly 
in this case the output 115" of the processor system has not yet been subjected to rendition. 

Fig. 8 represents a very important special case of the Fig. 6 system. If the resolution function in Fig. 6 yields a 
sharpening parameter value of zero, the drawing may be interpreted to mean that the system performs all of the process 
steps in the adjacent-element data path including multiplication by zero. 

This pointless processing would be even more wasteful than actually computing some small adjustment value 
(representing an adjustment of perhaps-marginal significance), and incorporating the resulting adjustment into the 
output data for printing. Fig. 8 indicates that all processing in the adjacent^ lement data path is turned off, not perlormed 
at all. when the results of that processing will not be used. 

For this purpose three toggle-switch symbols 51 -53 are incorporated into Fig. 8; with these symbols there shall be 
understood this convention: process modules lacking all necessary inputs do not operate. Naturally physical toggle 
switches are not normally employed; rather the corresponding processes are simply suppressed by software control. 

All three "toggle switches* or process-suppressing input control points are actuated by the module 228 that defines 
and evaluates the resolution ratio. When this module indicates that enlargement by a sufficiently high factor is occurring, 
it (figuratively speaking) rotates 54, 55 : 56 the movable arm of each toggle switch symbol downward to close the first 
two switches 51 and 52, and direct the input level 221 , 231 through the lower contact of the third switch 53 to the sum- 
finding module 241. 

The neighbor-level inputs 222 then pass through the first switch 51 to the neighbor-level finding and averaging 
modules 227, 234, actuating these modules to operate and transmit an average 235 into the differencing module 236. 
Selected-pixel information 232 also passes through the second switch 52 to the same differencing module 236. 

These two inputs actuate the differencing module to compute and direct a difference 237 to the multiplication 
module 239, and that module multiplies the difference 237 by a fixed factor 57 - established 238 by the resolution- 
40 function module 228. 

The resulting product 240 is added in the summing module 241 to the input level 221 , 231 received through switch 
53 as mentioned above, generating an adjusted level 243 - which proceeds from the adjusting stage to the using stage 
244. From the foregoing it will be understood that for adequately high resolution ratios the system operates exactly as 
in Fig. 6. 

For low (including fractional) resolution ratios, however, the "toggle switch - arms all move upward - cutting off all 
inputs and therefore all operation of the neighbor-level processing modules 227, 234, 236, 239, 241. The upward- 
rotated arm of the third toggle switch 53 also pipes the input level 221, 231 through the otherwisedisabled adjusting 
stage directly out to the level-using stage 244. That stage prepares 214 output data 215,246 - that have not been 
sharpened - for passage to the output device 217. 

Fig. 8 thus represents one form of step-function system, i_e^ a system in which some step-function of the two 
resolution values 23, 24 is formed 228 and made to control 54, 55, 56, 238/57 the system processing. Here: 

■ the step-function has exactly two states; 
55 ■ the resulting control is either on or off; and 

■ when it is on, only one factor 57 is used in weighting (multiplying by the sharpening parameter S) the deviation of 
the selected element level V(x,y) from its average surroundings. 
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Even with a step-function, a relatively elaborate function of the two resolution values 223. 224 could be used as a basis 
or trigger. For instance the function could be a polynomial, or a compound fraction, employing those two values. We 
have found it satisfactory to make the basis function a simple ratio: the output-device resolution 224 divided by the 
input-device resolution 223. 

5 Regardless of the triggering function, the use of a step-function calls for some sort of cut-off value at which the 

output undergoes its step. We have found it particularly useful to turn the full processing on if the ratio of resolutions 
is more than two , and off if it is two or less. 

Also to be established is the sharpening factor S (the fixed factor 57 in Fig. 8) which is employed when the step- 
function is 'on". Our work has included collecting opinions of visual acceptability from representative users, for a con- 
jo siderable range of values of the sharpening-factor S. 

General agreement was obtained that a sharpening factor of two provided distinct improvement over an unsharp- 
ened image, for essentially all large values of the resolution ratio - although many respondents reported definite esthetic 
preference for images prepared using a value as high as four. Objectively, such a high value is undesirable because 
it can lead to extremely conspicuous artifacts if the original image has small, subtle imperfections specks, dots, 
'5 hairlines, etc. ■- that are processed by the sharpening. 

We therefore consider it ideal to use a sharpening factor of two. Any value between, very roughly speaking, about 
and 254 will yield nearly equivalent results, and values between about V/> and 3 will yield results that are quite 
acceptable to representative users. 

We believe that implementing the inventbn with a simple step-function of resolution produces satisfactory results 
20 even with output devices that actually print multiple density levels. Such implementation with a simple step-function is 
especially successful, however, with an output device that uses single-bit binary rendition. This means the device 
simply either prints or does not print one unit quantity of ink, which is consistent with respect to each colorant, in each 
element of the image. 

Fig. 9 illustrates a preferred method embodiment of the fourth aspect of the invention, performed generally in 
25 accordance with operation of the Fig. 6 apparatus. Figs. 10 and 11 illustrate two alternative preferred embodiments of 
the Fig. 9 method. 

In both these alternatives, the adjacent-neighbor gray-scale levels are conceptualized as first grouped and read, 
in a substep 527, by subsets - the elements along the x (carriage scan) axis being defined in one group 61 , and those 
along the ^ (print-medium advance) axis in another group 62. Then these two data subsets proceed separately into 
30 the adjusting step 542. 

Now in Fig. 1 0 the adjusting step has a weighted-averaging substep 534, which in turn consists of several arithmetic 
operations. Each subset is weighted 63, 64 by a respective weighting factor - that is to say, a factor that is different 
for the ±x vs. the ±y subsets. The weighted values are added 65 together, and then divided 66 by the sum of the 
weighting factors to yield the weighted average 535. 
35 This weighted average is then used in the same way as the unweighted average in systems introduced earlier: its 

difference relative to the selected-element level 32 is found 36 and passed on to a multiplication substep 39. This 
substep forms a product 40 of the difference 37 and the sharpening parameter 538. 

Preferably the substeps 527, 534, 36, 39, 41 in the neighbor-element data path are all inhibited in a step-function 
mode, as in the apparatus of Fig. 8. In any event the product 40 is then added 41 to the selected-element level 31 , to 
40 provide an adjusted level 543 which is used as before. 

As will now be clear, the Fig. 10 system produces a sharpened level 543 that is controlled by the departure of the 
selected-element level V(x,y) from a specialized form of average of the adjacent-neighbor levels - in which some 
adjacent neighbors are treated as more important than others. This may be one appropriate methodology where, for 
example, the output device is known to have different resolutions in two directions, as in the case of the previously 
is introduced data plane K (Fig. 5) for printing black. 

Fig. 1 1 shows an alternative approach, also illustrated using the "toggle switch" convention employed earlier. Either 
the ±x elements or the ±y elements 61, 62 - but not both - are found and read, and fed to the adjusting step. Here 
an average 71 or 72 is formed as before, but only for Ihe received ±x or ±^ elements. 

The resulting average 71 or 72 is selected 77 and passed 75 to a differencing substep 36. The rest of the process 
so is exactly the same as that which follows the more-complete four-element average of Fig. 9 but takes into account 
only the neighbors, along one axis x or_y (carriage scan or medium advance respectively). 

This approach follows from a similar rationale to that of Fig. 10, and may be regarded as a special (or extreme) 
case of that system. In this Fig. 11 case, one of the two weights is reduced to zero -- with the advantage that the 
associated now-unnecessary processing can be "turned off" as in Fig. 8. 
55 The above disclosure is intended as merely exemplary, and not to limit the scope of the invention - which is to be 

determined by reference to the appended claims. 
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Claims 

1. Apparatus (1) for printing an image (15. 18) on a print medium (4) as marks formed in an array having output- 
device resolution (16: 24, 124, 224). based upon input image data (12, 112, 212 etc.) defining a pixel array having 

5 input-data resolution (1 3: 23, 1 23, 223); said apparatus comprising: 

means (25, 125 etc.) for finding at least one equivalent gray-scale level (31-33, 131-133 etc.) for a selected 
element (x, yj of the input data, and for each of a plurality of elements (x,y-1 ; x-1 ,y; x+1 ,y; x.y+1 ) of the input 
data that are near the selected element, respectively; 
w means (42, 142 etc.) for automatically adjusting the equivalent gray-scale level for the selected element to 

derive a new equivalent gray-scale level (43, 115', 231, 243 etc.) which depends upon: 

a function (38 etc.) of both the output -device resolution (24 etc.) and the input<iata resolution (23 etc.), and 

15 the found equivalent gray-scale levels (31 -33 etc.) for the selected element and each of said plurality of 

near elements; and 

means (44, 145, 244, 444, 544, 644) for using said now equivalent gray -scale level to form corresponding 
output data (46, 146, 246 etc.) having said output<tevice resolution. 

20 

2. The apparatus of claim 1 . in further combination with: 

an output device (17 etc.) for printing the selected element on such print medium using said output data; and 
wherein preferably: 

25 the output device comprises a thermal-inkjet pen (8M, 8C : 8Y t 8K), and 

the finding, adjusting and using means comprise at least one digital microprocessor (26, 42, 44; 144, 125, 
142; etc.) programmed to perform said finding, adjusting and using. 

30 3. The apparatus of claim 1 , further comprising: 

means (28, 128 etc.) for defining and evaluating said function (38) of both the output-device resolution and 
input-data resolution for the selected element; and 

wherein preferably said function is a function, ideally a step function, of the ratio of the input-data resolution 
35 to the output-device resolution for the selected element. 

4. The apparatus of claim 3. wherein: 

preferably said step function is on the order of two for certain values of said ratio, and is on the order of zero 
40 for other values of said ratio; and 

preferably said step function takes one value if said ratio does not exceed approximately one-half, and other- 
wise takes another value. 

5. The apparatus of claim 1 . wherein: 

45 

the adjusting means comprise means (34, 36, 39 : 41) for adjusting the equivalent gray-scale level for the 
selected element to a new equivalent gray-scale level which is substantially equal to; 

the found equivalent gray-scale level (31) for the selected element, plus (41) 

so 

the product (40) of [a] the said function (38) and (b] a quantity (37) which depends on the found equivalent 
gray-scale levels (32, 33) for the selected element and each of said plurality of near elements; 

said quantity (37) preferably being the difference (37) between: 

55 

the found equivalent gray-scale level (32) for the selected element and 

an average (34) of the found equivalent gray-scale levels (33) for each of said plurality of near elements. 
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6. The apparatus of claim 1 . further comprising: 

means (227. 234, 236, 57, 239, 241) for enhancing contrast within the image: and 

means (51. 52. 53: 54, 55, 56, 228) for automatically turning the enhancing means on or off selectively, de- 
pending on a relationship between the output-device resolution (224) and the input -data resolution (223). 

7. A method of printing an image on a print medium as marks formed in an array having output-device resolution, 
based upon input image data defining a pixel array having input-data resolution; said method comprising the steps 
of: 

finding (25) at least one equivalent gray-scale level for (26) a selected element (x.yj of the input data (21). 
and for (27) each of a plurality of elements (x,y_-1 ; x+1 jf; etc.) of the input data (22) that are near the selected 
element, respectively: 

automatically adjusting (42) the equivalent gray-scale level (31, 32) for the selected element to derive a new 
equivalent gray-scale level (43) which depends upon: 

a function (38) of both the output-device resolution (24) and the input-data resolution (23), and 

the found equivalent gray-scale levels (32, 33) for the selected element and each of said plurality of near 
elements; 

using (44) said new equivalent gray-scale level (43) to form corresponding output data (46) having said output- 
device resolution; and 

printing (17) the selected element on such print medium using said output data. 

8. The method of claim 7, for use in printing said image in color, using an output device (17) that has different reso- 
lutions (16) for different colors (C, M, Y, K); and wherein: 

said function is a function of all the resolutions for the colors which the output device can print: and 
preferably said function used with respect to each color is a function of the output<tevice resolution for that 
color and the input-data resolution for that color. 

9. The method of claim 7, for use in printing said image using an output device (Fig. 11 ) that has different resolutions 
(16y K , 16Xk, Fig. 5) along different dimensions of said mark-formed array and different dimensions of said input- 
data pixel array; and wherein said function: 

is a function of all the resolutions for said different dimensions, and 

preferably comprises weighted functions (61 , 62) used with respect to each common dimension, respectively 
of said input-data pixel array and said mark-formed array. 

10. The method of claim 9, wherein: 

said finding step comprises finding said at least one equivalent gray-scale level for each of a plurality of ele- 
ments of the input data that are near the selected element along, exclusively a particular common dimension 
of said input-data pixel array and said mark-formed array; and 

in said adjusting step, said new equivalent gray-scale level depends upon said function and the found levels 
for the selected element and, exclusively, said elements along said particular common dimension. 
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FIG. 5 
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(54) Resolution-triggered sharpening for scaling of a digital-matrix image 



(57) Method and apparatus (1) prepare an image 
(11 . 12) for printing -- and in some cases include an out- 
put stage (18), performing the actual printing - when the 
overall number of pixels is being scaled up or down from 
an original image or portion (12, Fig. 4). Image-sharp- 
ening procedures are controlled automatically by a func- 
tion (38) of the number (23) of pixels in the original image 
and the number (24) in the output device. Any of a great 
variety of such functions may be used, but we prefer a 
step-function of a ratio of the two pixel counts - partic- 
ularly a two-valued step-function in which one value is 
zero and the other serves as a sharpening factor in a 
sharpening algorithm. When the function yields its zero 



value, for efficiency the sharpening computations are 
preferably turned off (51 , 52, 53), The nonzero value is 
automatically selected when the number of output pixels 
is more than twice the number of input pixels. The sharp- 
ening-factor value, ideally two, is multiplied (39) by the 
deviation (37) of each image element's, ej3 pixel's (x, 
y), level (32) from the corresponding average (34) of the 
levels (33) for its adjacent neighbors (x-1 ,v; x,y-1 ; x+1 ,y; 
x,y+1); this product is added to the level of the subject 
image element to form an adjusted level. Weighting (61 , 
71 ; 62, 72) or selection of neighbor values along partic- 
ular axes (x, allows for anisotropic resolution or an- 
amorphic scaling. 
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